Control Theoretical Approach to Quantum Control 
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We derive the quantum stochastic master equation for bosonic systems without measurement 
theory but control theory. It is shown that the quantum effect of the measurement can be represented 
as the correlation between dynamical and measurement noise. The transfer function representation 
allows us to analyze a dynamical uncertainty relation which imposes strong constraints on the 
dynamics of the linear quantum systems. In particular, quantum systems preserving the minimum 
uncertainty are uniquely determined. For large spin systems, it is shown that local dynamics are 
equivalent to bosonic systems. Considering global behavior, we find quantum effects to which there 
is no classical counterparts. A control problem of producing maximal entanglement is discussed as 
the stabilization of a filtering process. 

PACS numbers: 03.65.Ta,42.50.Lc,02.30.Yy 



I. INTRODUCTION 

The quantum stochastic master equation has been de- 
rived by analyzing a measurement process carefully P, Q 
in combination with the notion of positive operator val- 
ued measure • Since it is based on the model that the 
measurement is made on the quantum system indirectly 
via an environment, the stochastic master equation is 
deeply involved in the input-output formulation 0, 0], 
which was introduced as a response to the physical ne- 
cessity for the formulation of quantum system interacting 
the traveling field. This formulation is compatible with 
control theory and extensively analyzed using the trans- 
fer function representation 6]. Due to the control theo- 
retical analysis, the full quantum treatment of feedback 
system and controller design was developed for quantum 
noise reduction problems 

The quantum stochastic master equation for bosonic 
fields has a decent property that the gaussianity of a 
density matrix is preserved in time. Thus, the full dy- 
namics of the density matrix can be described by up to 
the second moments d, |^ ^3 ; ^'^'^ the covariance matrix 
of the canonical observables obeys the matrix analog of 
second order equation, the Riccati differential equation, 
which is widely known in control theory such as linear 
quadratic Gaussian control, estimation, H2 and Hoo con- 
trol [llL IT^ . These formulations of the quantum stochas- 
tic master equation is, however, based on the Hamilto- 
nian formulation and incorporated with physical treat- 
ments, and therefore sometimes misled engineers about 
the back-action of the quantum measurement. 

In this paper, we derive the stochastic master equa- 
tion from a general description of linear quantum sys- 
tems via the transfer function representation j^. In this 
treatment, we do not assume any underlying physics and 
Hamiltonians. The only assumption imposed here is the 
noncommutativity of the input and the output signals. 
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Although all parameters of the linear quantum system 
are left undetermined, the noncommutativity leads to 
strong constraints on the transfer function and allows us 
to obtain the equivalent model to that of physics. These 
constraints are characterized by the fact that the poles 
and zeros of the transfer function are distributed in the 
complex plane subject to a certain rule. This includes sig- 
nificant information when one designs a quantum system 
because the zero and pole of the transfer function com- 
pletely determine the statistical properties of the output. 
Then, the stochastic master equation can be derived as 
a conditional density of the linear system with the con- 
straints. The quantum mechanical constraints can also 
be characterized by the detectability condition via the 
Hamiltonian matrix associated with the algebraic Ric- 
cati equation. 

These ideas can be extended to spin systems usin g th e 
quasiprobability distribution function on the sphere |l3| . 
At first we will show the fermionic analog of the relation 
between the superoperators and the differential operators 
by means of the so-called star product. This relation al- 
lows us to establish the same formalism as the bosonic 
case for the local behavior of a large spin. The global 
behavior of the large spin is considered for quantum non- 
demolition (QND) measurement. This formulation of the 
spin system shows that the leading expansion with re- 
spect to the spin number has the corresponding classical 
system. Dealing with higher order expansion, we will 
see a quantum effect of measurement in the back-action 
process to which there are no classical counterparts. 

For experimental and practical reasons, spin systems 
are thought of as an important basis for quantum in- 
formation processing, and controlling spin systems is a 
indispensable technology for it. In particular, spin en- 
tanglement is an important subject of quantum control 
and a lot of experiments have been performed using QND 
measurement in recent years 

[llllllll- This problem 
can be reduced to the stabilization of the spin system 
with a stochastic noise. We will consider the production 
of the maximal entanglement with the use of feedback 
based on the global description of the large spin system. 
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This paper starts with Sec ITTI which is a brief review of 
classical linear system theory for introducing control the- 
oretical notions to quantum systems. In Sec lIIII and llVI 
filtering theory is overviewed. Sec0 introduce the gen- 
eral formulation of linear quantum systems, and the un- 
certainty relation is stated in terms of the transfer func- 
tion in Sec lVIII We formulate measurement on linear 
quantum systems in Sec I Villi through which the uncer- 
tainty relation is stated again in terms of detectability in 
Sec lIXI The mathematical basis for the spin system is 
developed in Sec lXIII The local behavior and the global 
behavior of the spin system are considered in Sec lXIIll 



and IXIVl respectively. The production of the spin en- 
tanglement based on the global behavior is discussed in 
SeclXVl 



II. LINEAR SYSTEM THEORY 



A linear system is described in the time domain as 



x{t) = Ax{t) + Bu{t), 
m{t) = Cx{t) + Du{t), 



(la) 
(lb) 



where vectors u, m and x represent the input, the output, 
and the state of the system, respectively. The linearity 
of the system allows us to express it in the frequency 
domain as 



m{s) = G{s)u{s), 



(2) 



where u(s), m(s) are the Laplace transforms of the input 
and the output. A function G(s) relating u{s) to m(s) is 
called a transfer function, defined as 



G{s) =C{s- A)-^B + D 



' A 


B ' 


C 


D 



(3) 



Each element of the transfer function is referred to as 
A, B, C and D matrices, respectively. 

The transfer function representation of the linear sys- 
tem shows that the state cc is a hidden information car- 
rier from the input to the output, and the choice of x is 
not important in the relation between them. The input- 
output relation is invariant under the similarity transfor- 
mation of X, i.e., for any nonsingular matrix T, 



(4) 



For the same reason, the stability is characterized by an 
invariant quantity under the similarity transformation. 
The system is said to be stable if ReA(A) < 0. X{A) 
denotes the eigenvalues of A, which are called the poles 
of G. 

B matrix determines the relationship between the state 
of the system and the input, and thereby involves in 
controllability of the system. The pair (A, B) is said 
to be controllable if, for any set of complex numbers 
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B ' 
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C 


D 






D 



A = {Ai,--- ,A„}, there exist a matrix K such that 
X{A + BK) — A. This definition indicates that the poles 
of G are assignable anywhere in the complex plane C 
by means of state feedback u = Kx. The pair {A, B) is 
said to be stabilizable if there exist a matrix F such that 
A+BF is stable. This is the case if uncontrollable modes 
are stable. Likewise, G matrix determines which element 
of the state is visible for an observer. The pair (C, A) 
is said to be observable if (A^jC^) is controllable, and 
detectable if there exists L such that A + LG is stable. 

In case of single-input-single-output (SISO) systems, 
due to D matrix, there exists an s on the complex plane 
for which G = 0. Such a point is called the zero of G 
and plays an important role in a wide class of control 
problems as a "norm" of the system is determined by 
both of the pole and zero of G. For example, if the input 
is a noise and the output is a quantity to be not affected 
by the noise, then one would design the system to have 
a small norm by appropriately distributing the poles and 
zeros on C. 



III. FILTERING 

The notion of observability is concerned with the deter- 
minacy of the initial state a;(0) from the output segment 
{m(s) |0 < s < of arbitrary length for a deterministic 
measurement. For a noisy measurement, a filtering pro- 
cess is required to extract information about the system 
subject to a certain criterion. 



A. uncorrelated noises 

Let us consider a nonlinear system with two indepen- 
dent noises represented as 



dx — a{x)dt + b{x)dw 
dm — c{x)dt + Ddv 



(5a) 
(5b) 



where w, v are independent normalized Wiener processes, 
and we have assumed that D is a constant matrix. The 
first equation describes the dynamics of x driven by the 
stochastic signal v, and the second one is the noisy mea- 
surement process. This system has the joint density 
p{x, to) of two random variables a;, to, and only to is di- 
rectly visible. A filtering problem is to find an optimal 
estimate of x, x, from the measurement outcome to. If 
we define the optimality by minimization of the mean 
square error P = Fi[{x ~ x){x — x)'^], then the estimate 
is given by a conditional expectation. For an arbitrary 
function 4>{x), the conditional expectation 



7rt(,^) :=E[(/.|m(s) (0 < s < t)] 



satisfies 



dTTtid)) =M^<l>)dt + kt(0c^) - 7rt(0)^t(c^)](DD^)-idv 

(6) 
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where 



IV. HAMILTONIAN MATRIX 



ijl 



and dv :— dm — 'Kt{c)dt, which is called the innovation 
process, is another Wiener process. Note that if DD^ 
is singular, the inverse can be replaced by the pseudoin- 
verse. 

From the conditional expectation ©, it can be easily 
seen that the conditional density 



It can be shown that under the measurement for an 
infinitely long time, the Kalman filter is in a stationary 
state if the stability is assured. (The convergence also 
holds even if the system is not stable, provided certain 
conditions are imposed.) Then, the Riccati differential 
equation for the covariance matrix is reduced to the al- 
gebraic Riccati equation, which is deeply related to the 
Hamiltonian matrix. 

A matrix H is said to be Hamiltonian if 



satisfies 



p{x,t) = VY[x(t)\m{s) (0 < s < t)] 



dp = L*pdt+{c~cy {DD^y^p dv, (7) 



EH + H^H = 0, 



(13) 



where 



-/ 
/ 



where L* is the adjoint operator of or the Fokker- 
Planck operator. 

In the linear case, a{x) = Ax, b{x) = B, c{x) = Cx, 
the mean x and covariance matrix P with respect to the 
conditional density p are given by 

dx = Axdt + PC'^{DD^)-^dv, (8) 
P = AP + PA^ + BS^ - PC'^iDD^y^CP. 

where dv — dm — Cxdt is the innovation process. This 
is known as the Kalman filter. The second equation is 
referred to as the Riccati differential equation. 



From this definition, it can be easily seen that the Hamil- 
tonian matrix is of the form 



H 



A R 



(14) 



where W, Q are symmetric matrices. Corresponding to 
this matrix, let us define an algebraic Riccati equation 
as 



XA + XA^ + XRX -Q = 0. 



(15) 



Let us consider a linear system with two normalized 
Wiener processes that are correlated as 



Let us denote by Ric[i7] a solution X satisfying ReA(yl- 
RX) < 0. 

From Eo. lfT^ . it follows that 



A + RX R 

-(A + RX)^ 



which implies that X{H) = X{A + RX) U \{-A - RX). 
Using Ea. lfT^ again, we have 
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0' 


H 


■ / 
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noises 


~X 


/ 


X 


/ 





{dv{s)dw^ [t)) =SdtS{t-s). 



(9) 



H 



' I ' 




■ / " 


X 




X 



(A + RX). 



(16) 



In this case, the conditional expectation is given by the 
Kalman filter 



dx = Axdt + {PC + BS){DD^ )~ dN. 
P = AP + PA^ + BB^ 



(10) 
(11) 



- {PC + BS){DD'^)-^{PC' + BS) 



As in the uncorrelated case, the conditional density is 
derived as the dual expression of the Kalman filter, given 

by 

dp = L*pdt + \c{x -x)- VBS"! {DD'^y^p dv. (12) 

Note that the correlation of the two noises appears as a 
derivative of first order in the coefficient of the innovation 
process. 



It turns out that Ric[i/] is given by X satisfying Ea. Hlt)|) 
with ReA(A + RX) < 0. For H which has eigenvalues 
on the imaginary axis, it is basically possible to obtain a 
solution of the Riccati equation due to the same proce- 
dure. This is the case if a quantum system is under QND 
measurement, as will be seen later. 

For an algebraic Riccati equation of the form 

AX + XA^ + BB^ - XC'^CP = 0, 

the corresponding Hamiltonian matrix is written as 

H = 



-BB^ 



-A 



In this case, there exists Ric[iJ] iff {C,A) is detectable 
and {A, B) has no uncontrollable modes on the imaginary 
axis. Moreover, if these conditions hold, Ric[i/] > 0. 
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V. LINEAR QUANTUM SYSTEM 



VI. CORRELATION AND NOISE REDUCTION 



In this section, we will introduce a basic formulation 
of linear quantum systems. Let w be a noncommutative 
variable such that 

[u{t),u\t')]^S{t~t'). (17) 

The signal can be decomposed into the real and imagi- 
nary parts as 

Ux = u + u'^ , Uy = — i(u — u^). 

Physically, these operators correspond to the amplitude 
of two phases of a signal constituted of the infinite num- 
ber of independent bosonic modes in free space. 

Let us consider a quantum system which converts the 
signal u into another quantum signal m(t) in the same 
space according to a completely positive map F given by 

m{t)=r{u{t))^u{t)*g{t), (18) 

where g is a function determined by F, and * represents 
the convolution of the operator u and the function g. 
u, m can be thought of as the input and the output of the 
quantum system. In the linear case, an adequate rotation 
in the output complex amplitude plane can choose the 
form of the output operator m such that m^;, ruy respond 
to Ux, Uy, respectively [17]. Then, the two phases can be 
decoupled as 



rrix 
rrir. 



G 



Gx 
G„ 



(19) 



where Gx , Gy are the transfer functions for each phase 
given by 



Gx 



\Ax 


Bx 


Gx 


Dx 



Gy 



Ay 


By- 


Cy 


Dy 



(20) 



In the time domain, this system can be represented as 

dx 
dy 



Ax 








drUx 
dmy 



Gx 






Cy 



dt 



Bx 






B„ 



du 

du> 



dt 



Dx 






Dy 



p 

dux 
duv 



(21a) 
(21b) 



where x,y are the internal observables of the system. 
They are noncommutative in general, however the ex- 
plicit relation between them is not necessary. Thus, al- 
though we denote them by x, y, it does not necessarily 
means that x, y correspond to position and momentum. 

The advantage of using transfer functions is that we 
can simplify the expression of complex networks. For 
example, the cascade connection of two quantum sys- 
tems represented by Gi,G2, which constitutes the sim- 
plest quantum network, is described by the product of 
the two transfer functions 



(22) 





" A, 


B1G2 


B1D2 ' 


G1G2 — 





A2 


B2 




Gi 


D1G2 


D1D2 



For any type of connections of systems, we can obtain a 
simple expression using transfer functions. 



Let us consider a quantum system in a density matrix 
p on a Hilbert space !K. To evaluate the correlation of 
noncommutative observables of the system with respect 
to p, we introduce a pre- inner product of operators Q, R 
on M as 113 

{Q,R)p ^ ^Ti- [p{QR^ +R^Q)]. (23) 

Let q{t) and r{t) be self-adjoint operators on 3i, and 
q{uj) and r{uj) be the corresponding Fourier transforms, 
respectively. The power spectrum §qr of q and r is de- 
fined as 



{q{uj), r{uj'))p = $qr{uj)5{oj - w')j 



(24) 



The correlation function 'Jlqr{t) of operators q{t) and r{t) 
is then defined by inverse Fourier transform of the power 
spectrum §gr(w). 

Returning to the decoupled system p9|l . it turns out 
that the absolute value of the transfer function deter- 
mines the power spectrum of the output signals, i.e., the 
power spectrum of is related to that of Ux via 



.{uj) = |G'a;(icj)pS„^„Jtj). 



(25) 



If the transfer function Gx is unitary, then the power 
spectrums of the input and output signals are equivalent. 
Such a system cannot change the statistical property of 
the input signal at all. However, if we design the system 
such that the absolute value of the transfer function Gx 
is less than unity on the imaginary axis of the complex 
plane C, the fluctuation of the input is to be reduced 
through the system in x-phase. Requiring stability of 
Gx, reducing the fluctuation of the input in x-phase can 
be stated as 



\Gx{s)\ < 1 



(26) 



in the left half plane of C. The output of the system 
satisfying the condition 12()|l is a squeezed state. If Gx 
has a zero on the origin in C then the system can produce 
the perfect squeezing asymptotically. This is the case if 
we use the quantum mechanical feedback and parametric 
amplifier, no matter how weak the performance of the 
amplifier is 

At this point, it seems that each element of the transfer 
function can take an arbitrary value, and there seems to 
be no differences between classical and quantum systems. 
However, there is a very strong constraint on the transfer 
function in the quantum case due to the noncommuta- 
tivity of the input and output signals, as will be seen in 
the next section. 



VII. UNCERTAINTY AND TRANSFER 
FUNCTION 

The specific feature of quantum signals is the existence 
of an additional skew-symmetric form. For arbitrary op- 
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erators Q, i?, we define 

[Q,R]p^iTr[p{R^Q-QR^)]. (27) 

Consider tlie SISO linear quantum system p9|) with an 
input signal u satisfying Ea. H17|l . In the frequency do- 
main, the input u is characterized by 

[u^{Lu),Uy{Lu')]p^ ^S{UJ + U}'). (28) 

It has been shown Q that the noncomutativity of the in- 
put and the output result in a following relation between 
the two phases: 



which verifies that Cx = Cp and + Ap = — C^. After 
all, we can express a general linear quantum system as 









F 


~Cx 





drrLx 







-hCl-F 





~Cx 


druy 




Cx 





1 












Cx 





1 



(32) 

where is a free parameter. Note that this form also 
holds for multi- input- multi-output systems if each matrix 
is nonsingular. 



Gx{s)Gy{-s) > 1. (29) 
If the output m also satisfies the relation 

[mx{uj),my{uj')]p = ^S{uj + uj'), (30) 
47r 

then the equality of Eq.|55J is achieved, i.e., 

Gx{s)Gy{-s) = 1. (31) 

This is the case when the input and the output are in the 
same space. 

The relation H31|l allows us to state the quantum the- 
oretical limitations on linear quantum systems in terms 
of control theory. Suppose that we design a quantum 
system such that Gx is stable and has a zero on the ori- 
gin in C to reduce the noise, as stated in the previous 
section. This system can produce the perfect squeezing 
asymptotically. Then, according to the relation H31|) , the 
transfer function of the other phase, Gy, has a pole at 
the origin, and consequently, Gy is unavoidably unstable 
and the noise is amplified to infinity. That is to say, in 
the quantum case, the zeros of Gx and the poles of Gy 
are distributed symmetrically with respect to the origin 
in C. And also, the trade-off between the two phases 
can be easily seen by taking the norm of the both side of 
Eq.dig, i.e., \Gx\\Gy\ > 1. 



It is worth noting that from Eas. (|25l31|l . the stochastic 
properties of the output is unconcerned with the noncom- 
mutativity of the internal observables. Once we obtain 
the transfer function of a quantum system, the charac- 
teristics of the internal observables is not significant for 
the input-output relation. 

Ea. H31|l allows us to simplify the transfer function 
of the quantum SISO linear system. One can choose 
Bx = Bp = —Cx with an appropriate similar transfor- 
mation. Since Ea. (|31|) holds for an arbitrary s, it follows 
that DxDp = 1. For a physical reason, it is natural to 
assume \Gx\ = \Gy\ at infinite frequencies. Thus, with 
an appropriate phase rotation, we have Dx = Dp = 1. 
Furthermore, Ea. H31|l leads to 

s(l - CxCp^) - {Ax + Ap + Cl) = 0, 



VIII. MEASUREMENTS ON LINEAR SYSTEMS 

Let us consider a measurement of a single phase of 
the output, say fUx, of the linear quantum system H32|l . 
This is called the homodyne measurement. The mea- 
surement projects the signals Ux^ Uy onto a commutative 
counterparts ^, t] with the same stochastic properties as 
the quantum ones. Since we are measuring only a;-phase, 
no information on y- phase is valid. Thus, we can repre- 
sent the measured system as 



(33a) 
(33b) 



where m is the measurement outcome, x, y are the states 
(we have used the same notations as Ea. ()21|l although 
they are commutative here) , and each matrix is given by 



X 

y 




A 


X 

y 


dt^ 


-B 


drj 


dm_ = 


C 


X 

y 


dt- 




dij 



A 



F 







1 1^2 

2^x 

-iC2 - F 



c = 



Cx 




B : 

D 



Cx 



1 






-Cx 



This is alternatively represented as 



dm 



1 (-12 

2 X 


+ F 


-Cx 

















Cx 




Cx 


1 





















d^ 

drj 



From the expression above, it is obvious that the second 
element of m is irrelevant. 

The projection postulate of the quantum theory means 
that the quantum system under measurements obeys a 
density conditioned on the measurement outcomes. Since 
for linear systems with correlated noises the conditional 
density is given by Ea. H12|) . which is obtained via the 
Kalman filter, we have the conditional density of the 
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quantum system on the phase space 

d 



dp 



F)y 



a 



X — ix) — 



pdt 

d_ 

dx 



P dv, 



(34) 



where v is the innovation process. Using the correspon- 
dences between the density matrix p and the density on 
the phase space p 



ap ■ 



a) p 



pa 
pa 



(« 



t ^ (a* 



ld_\ 

l_d_ 

ld_\ 
^ 2d^) 



(35a) 
(35b) 
(35c) 
(35d) 



where a is the annihilation operator and a := (x + iy)/2, 
we obtain the quantum stochastic master equation 



(J2 

dp =—^{2apa^ — a^ap — pa'^ a)dt 



(36) 



+ [F(a^a^ — aa), p\dt + Cx{ap + pa^ — {x)p)dv. 

Note that the derivation of this stochastic master equa- 
tion started from Ea. l(^ . 

The derivatives in RHS's of Eq.(j2Hl come from the non- 
commutativity of the operators a,a\ and therefore the 
derivative in the innovation process of Eq. (|34|l is the con- 
sequence of the fact that we are measuring the operator- 
valued variable. On the other hand, as the Kalman filter, 
the derivative results from the correlation between the 
dynamical noise and the measurement noise, as stated 
earlier. Thus, the quantum effect of the measurement on 
linear quantum systems is expressed as the classical noise 
correlation. 

Let us consider the first moments of noncomniutative 
observables x, y subject to Ea. (|36|l . defined as i = Tr (a+ 
a^)p, y = iTr (a^ — a) p. They are calculated as 



X 


= A 


X 













dt + {PC' +B){DD' ) 



T\-l 



d^ 

drj 



(37) 



where the covariance matrix P obeys a Riccati differen- 
tial equation 



P =AP + PA^ + BB'^ 



(38) 



{PC + BS){DD'^)-\PC' + BS) 



Now it is obvious that this is equivalent to Ea. H10() . 

Assume that (C, A) is detactable and {A, B) is stabiliz- 
able. Then, the system is in the stationary state after the 
measurement for an infinitely long time [20j , and Eq. H38|) 



can be reduced to an algebraic Riccati equation associ- 
ated with a Hamiltonian matrix 



H = 



91 

2 



F 





- ^ _ 

2 





F 



-CI 



2 ^ 



% 



F 



(39) 



If F > — Cj/2, the eigenspace corresponding to the neg- 
ative eigenvalues of H is spanned by 



1 





















(1 





1 



2F ) 



(40) 



According to Ea. (|15|l . one can obtain the stationary co- 
variance matrix P given by 



P = 



2F 









(1 + !^)-^ 



(41) 



This implies the trade-off between the variances of the 
two phases, as expected from the uncertainty relation. It 
should be noted that this trade-off results from Ea. (|31|l . 
If F = 0, the system asymptotically goes to the vacuum 
state, which is also physically natural. 



IX. STATIONARY UNCERTAINTY 

So far, we have seen the constraints resulting from 
Ea. (|31|) . In this section, we shall consider the general 
case of Ea. (j29|l . For a quantum system the covariance 
matrix satisfies the following inequality |19| |: 



p + n>Q, 



(42) 



where 



-i 

1 



In the static case, P = Ric[iJ] with a Hamiltonian matrix 

(43) 



H = 



(A-B5C)t -etc 
-B{I-S^)B^ -{A- BSC) 



where the transpose is generalized to the complex conju- 
gate. 

Let us consider the similarity transformation of H with 
a matrix 



T = 



/ 

n I 



From the definition H13(l . it turns out that THT^^ is also 
a Hamiltonian matrix. From the definition of Ric[_ff], we 
have 



H 



I 




I 


mc[H] 







N 
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for a matrix N such that ReA(iV) < 0. PremultipHcation 
of this equation by T verifies that 



THT- 



Ric[H] + n 



I 

Ric[H] 



which imphes that Ric[THT-^] ^ Ric[H] + Q. 

The stationary uncertainty relation (|42() is now equiva- 
lent to the condition that Ric[THT^^] > 0. Let us define 
At , Bt and Ct by 



-At 



(44) 



From the statement on the positivity of the solution to 
the algebraic Riccati equation in Sec lIVI all linear quan- 
tum systems are subject to the condition that {Ct,At) 
is detectable and {At,Bt) has no uncontrollable modes 
on the imaginary axis. 

For example, in the case of the linear quantum system 
or the corresponding Hamiltonian matrix (|39|l . it 
can be easily shown that 



THT-^ = 



2 ^ 








- F 



91 

2 



F 



For F > — this system satisfies the condition shown 
above. Moreover, in this case, Bt = reflects the fact 
that the system achieves the equality of the uncertainty 
relation. 



are still uncertainties on the initial state, and the quan- 
tum system under the measurement is different from our 
knowledge. However, the stability of the Kalman filter 
guarantees that they agree with each other asymptoti- 
cally. In this case, the target of our control using the con- 
ditional expectation E{x\m) is the Kalman filter or our 
knowledge itself, instead of the marginal density p{x), 
and consequently, quantum control with measurements 
is equivalent to controlling a nonlinear system with state 
feedback. 



XI. EXAMPLES 

In this section, we will see simple examples in which the 
stochastic master equation derived from a system theo- 
retical point of view consists with a physical derivation. 



A. single mode 

In the case of a cavity, the input and the output is 
the traveling wave in free space and the state is a single 
mode inside the cavity. The infinitesimal evolution of the 
system is given by a unitary operator 

U{dt) = exp[K{a iSi du^ - a iSi^ du)], 

where a is the annihilation operator for the cavity mode, 
u is the traveling field before the interaction with the 
cavity, and K is a coupling constant. The cavity system 
before measurements can be expressed as 



X. WHAT DO WE CONTROL? 

In the classical case, the Kalman filter is used to esti- 
mate the state of a system, and we usually assume that 
the system is not influenced by the estimator, i.e., the 
evolution of the system does not depend on how we es- 
timate the state. Then, the system is described by 
the joint density p{x,m), and the Kalman filter ifTUIl is 
used to obtain the conditional density p{x\m), which de- 
scribes our knowledge about the system. Using the condi- 
tional expectation E(a;|m), we control the marginal den- 
sity p{x). 

In the quantum case, the joint density p{x, y) describes 
the system before measurements, or pre-measurement 
system. If we make a measurement on the system (I21II , 
it no longer obeys H21() but the Kalman filter (|37|l . This 
is what the back-action of measurements means and the 
consequence of the projection postulate. In other words, 
the quantum system refiects our knowledge about the 
system. Thus, the innovation process can be thought 
of as the back-action process of the measurement, and 
our knowledge and the quantum system itself are con- 
tinuously updated by the measurement outcome. There 



drrix 




■ A 


B ' 




dux 


dniy 




C 


D 




duy 



where m is the traveling field immediately after the in- 
teraction. Each element of the transfer function is given 

by 



A 



El 

2 



c = 






, B = 


' -K 







2 




K " 


, D = 


" 1 


K 


1 



Thus, from Ea. H36|l . the cavity under the homodyne mea- 
surement is described by a density matrix p satisfying 



dp =-^(2apa^ — aa^ p — paa^)dt 
+ K{ap + pa^ — (a + a'')p)dv, 



(45) 



where dv is the innovation process. This is equivalent to 
the standard stochastic master equation for the optical 
system 01 . 
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B. deterministic input 



XII. SPIN WIGNER FUNCTION 



Let us consider an additional deterministic input to 
the system ()45f) described by a Hamiltonian 



H 



-hy{a + a') — ihx{a — a^), 



where hx , hy 



are control gains. The conditional expecta- 
tion is then given by 



d 


X 


=A 


X 


dt + 


hx 




. y . 




. y . 




hy 



dt + {PC^ - B)dY, 



P 



--AP + PA 
- {PC^ -+ 



BB' 



(46a) 
(46b) 



B){DD^)-\PC^ + B) 



where each matrix is given by 



A: 



C 





2 " 
" 2 

K 




B 



D 



-K 


1 0' 






-K 



Since the control input hx, hy is deterministic and linear, 
the covariance matrix P is independent of the input. This 
fact simplifies the design of the input to stabilize the 
Kalman filter. However, this is not the case in general, as 
will be seen later, and it is difficult to show the stability. 



C. additional noise 

Assume that a classical noise is added to the system 
during signal processing before we obtain the measure- 
ment outcome m^ . The whole system is described by 



2 

- 




2 


-K 





~K 


" 




K 





1 


5 











drj 







(47) 



where ^ is the additional Winer process independent of 
^, 77, and S is the strength of the noise. For this equation, 
DD^ = 1 + so the stochastic master equation is given 
by 

^2 

dp =—^{2apa^ — aa) p — paa))dt 



+ 



K 



f +(52 



{ap + pa) — (a + a))p)d\_. 



This is equivalent to the stochastic master equation for 
the photon detector with efficiency 1/(1 -I- (5^), in which 
C, is thought of as a noise induced by undesirable opti- 
cal modes. In reality, we cannot discriminate between 
the classical and quantum noise in the measurement pro- 
cess. Eg . H45(l has assumed an ideal signal amplification of 
the photon detector. If we can obtain the full dynamical 
model of the measurement process, including information 
and noise processing in the photon detector, the stochas- 
tic master equation would be of a different form. It would 
be described by the Kalman filter for a cascade system 



The phase space formulation is compatible with the 
classical formulation and allows us to understand quan- 
tum systems on the classical language. We have seen that 
once the transfer function representation of a quantum 
system is obtained, the stochastic master equation natu- 
rally follows from the Kalman filter in a classical way. A 
spin system is described by a density on a sphere, instead 
of the phase space, and the spherical constraint leads 
to the nonlinearities of the dynamics. The calculation 
of a conditional density then leads to a general filtering 
problem. For spins, however, there does not necessar- 
ily exist the classical filter corresponding to the quantum 
stochastic master equation. In this section, we will ex- 
amine the classical counterparts to spin systems under 
measurements . 

For an operator X on a Hilbert space representing an 
S'-spin system, let us define a function as 



Wx{^) = Tr Xw{n), 



where 



w{n) 



An 



2S L 



2S 



(48) 



(49) 



L=QAI=-L 



Ylm{^) are the spherical harmonics and Tlm are the ir- 
reducible tensors of rank L, or the polarization operator, 
which are, in terms of the basis spin functions, defined 
as 



T, 



LM 



2L + 1 



2S 



jT.^s'^^LM\Sm'){Sm\, (50) 



where C|™ ]^J^,J are Clebsch-Gordan coefficients. For a 
density matrix p of the spin system, the function Wp has 
the same properties as the optical Wigncr function. For 
example, the expectation of an arbitrary operator A with 
respect to p is expressed as 

Tr pA = I dn WpWA, (51) 

where dil — sin 9d9d(p. From Wp, p can be reconstructed 
via the relation 

2 S* + 1 f 

p = ^ / dn w{n)Wp{n). (52) 

Let us define an operator T as 

y{WAWB) = Wab- (53) 
For the S'-spin system, T is given by 

i-iy 



^=E 



j!(25 + j + l)! 



V2S + 1F-\L^ 



(54) 



{3?+^F(i:2)0 3?-JF(i:2)|^ 
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where F is defined by 



and 



Fiii^)YLM = y/{2S + L + l)\{2S-Ly. Ylm, 



p2 f nd 19' 

= - TTTTT +COt^ \ 



3-1 



sm 



k=0 



Note that and "Jl^^ are commutative. In the large spin 
hmit S" 3> 1, y can be simphfied as 

?= 1(g) l + 31+1-3^+1® 3^-1), (55) 

where e = (25 + 1)^^ ^ 1. Let us define complex num- 
bers a, a* as 



a = e sm w, 
a* = e-''''sm0. 



(56a) 
(56b) 



In the limit of 6* ^ 1, 3?* can be represented as 

d 



3?- 



9q;' 
9 



3?+i - -e"'"^ — . 

The spin angular momentum operator or briefly the 
spin operator, can be represented by a set of three (25* + 
1) X (25*+ 1) matrices. Using the polarization operators, 
the spherical components of the spin operator are given 

by 



^, S{S+l)i2S+l) ^ 
^±=T\I 5 Ti±i, (57a) 



_ SiS+l){2S+l) ^ 
^0 — \ J-io, 



and the cartesian components are 

5, = (5+ + 5_), 
Sy = -i{S+ - 5"^), 

Sz — Sq. 



(57b) 



(58a) 
(58b) 
(58c) 



For the spherical components of the spin operator, the 
definition yields 



SjS + l) . 
e ^ sm 



S{S + 1] 



a, (59a) 



W,_^J^e-*.ine^,m^c.: (59b) 



Ws„ = VS{S + 1) cosy. 



(59c) 



Let us consider the action of the spin operators on 
the density matrix in terms of the spin Wigner function. 
According to Ea. H55|l . we have 



2 9+1 



An 

2S+1 
An 



(60) 



dflw 



SiS+l)f e d 

["+2d^r^ 



The other forms can be calculated in the same way, and 
we obtain the following correspondences between the spin 
operators and the differential operators: 





-1) 


2 


'5(5 4 


-1) 


2 


'5(5 4 


-1) 


2 


'5(5 4 


-1) 


2 



a 4 


e d ^ 
' 2d^^ 




(61a) 


a* ^ 


e d ^ 
~ 2da^ 


)Wp, 


(61b) 


a — 


e d ^ 
2da*y 




(61c) 


a* 


e d ^ 
^ 2 9^. 




(61d) 



S+p ■ 
S.p 
pS+ 
p5_ 



These relations are similar to the bosonic case ()35|l except 
for the small parameter e in the second terms. 



XIII. LOCAL BEHAVIOR OF LARGE SPINS 

The correspondences shown above involve the complex 
parameters a, a* . This fact implies that in the large spin 
limit, the spin operator can be related to the creation and 
annihilation operators of the basonic system. In fact, the 
relation between the spin operator and creation and an- 
nihilation operators can be directly seen from the com- 
mutation relation of the spin operator. Let us define 
operators A± , by 



A± =/i5^, 

Az = 5r 



1 



where /i is a constant. They obey the commutation rela- 
tions 

[A^,A+] ^l-2\^Az, 
[A±,Az] =A±. 

Thus, if A ^ 0, we have the correspondences 

A+^a\ (62a) 
A_ ^ a, (62b) 
Az ^ a^a. (62c) 



From Ea. H56|) . it turns out that the north pole of the 
sphere corresponds to the origin of the phase space so 
that the the spin function |55) is the ground state. Thus, 
we have 

lim^, 1 55) = 0, 

c— >0 
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which impHes S ~ {2fj,'^)~^, and consequently, 5' ;:!> 1 is 
required for the correspondences (|62l) to hold. 

Let us consider the measurement of x component of 
the spin operator with damping. The stochastic master 
equation is given by 



if2 

dp =—{2S+pS- 



pS-S+ — S-S+p)dt 
K{S+p + p5_ - {S+ + 5_)/9)dy, 



where v is the innovation process resulting from the mea- 
surement of Sx- Define two variables as 



X 
Y 



V2S + 1 



1 1 



a 

a* 



where w, v are independent normalized Wiener processes. 
These equations exactly reflect what QND measurement 
means. Ea. H65a|l indicates that under QND measure- 
ment of Sx, the corresponding variable X is not affected 
by the dynamical noise. However, there is the measure- 
ment noise v which comes from the interaction between 
the spin and the external field for extracting information 
from the system. Because of the measurement noise, the 
measured system must be described by the conditional 
density, or the Kalman filter of Ea. (|65|l . and then X is 
subject to the back-action noise v. 



XIV. GLOBAL BEHAVIOR OF SPINS 



Ea. l|()l|l leads to the stochastic master equation for the 
spin Winger function written as 



' 2e 



d 

dX 
K r 



X 



X 



_d_ 

dY 
d 



Y 



52 



dX^ dY^ 



Wpdt 



dX 



-{X) 



Wp dv 



(63) 



This is the same as the evolution of the conditional den- 
sity for the bosonic system ()34|l . Thus, the local behavior 
of the large spin is equivalent to the bosonic system, and 
the stochastic master equation can also be derived as the 
Kalman filter of the following pre-measurement system: 



X ' 

Y 




2c 

- 




2e 




' X ' 

Y 


dt + 


rfm 




"4 o' 




■ X ' 

Y 


dt^ 


[1 



-4 



drj 



d^ 
dr/ 



Each element of A, B and C matrices grows with the 
number of spins, and consequently the measurement 
noise relatively becomes small accordingly. In other 
words, the measurement of the large number spin is al- 
most deterministic. 

In the case of QND measurement of the x component 
of the spin, Sx, the stochastic master equation is given 
by in 



In the previous section, we have seen that the local be- 
havior of a large spin is well-described on the local XY 
plane at the north pole of the sphere. The x and y com- 
ponents of the spin is equivalent to the two phases of a 
bosonic system, and thereby described as the filter of a 
linear classical system. For the global behavior of the 
large spin under QND measurement, it is convenient to 
use the z component for a mathematical simplicity. We 
assume here that, in addition to the QND measurement, 
there is a control parameter which allows us to rotate 
the spin about y axis with a control gain h. The stochas- 
tic master equation for the conditioned density matrix is 
given by 



dp =[-ih[Sy,p] - —[Sz, [Sz,p]]^dt 
+ K({Sz,p}-2{Sz)p)dy, 



(66) 



where y is the innovation process. 

Let us rewrite the stochastic master equation for the 
spin Wigner function Wp. For details, see Appendix. It 
can be shown that the commutation relation with the 
cartesian components of the spin operator Si [i = x, y, z) 
corresponds to the orbital angular momentums iLj as 



[S^,P] 



-l^:Wp. 



dp 



[Sx, [Sx,p]]dt + K[{Sx,p} - 2{Sx)p)dv. 



To zeroth order of e, Ea. (|61|l yields 

^ ^W'^^''^^ TTe^^ ~ ^^^^^^ ^^^^ 

From Eq.([7|l, it can be easily seen that this stochastic 
master equation is equivalent to the Kalman filter of the 
following pre-measurement system: 



" X ' 


K 


"O" 


Y 


~ y/2k 


1 



dw 



dm.,, = 



K 



[1 0] 



X 
Y 



dt + dv. 



(65a) 
(65b) 



Unlike the commutation relation, the anticommutation 
relation with Sz has a complex form. It can be given to 
order of e by 



{Sz,P} 



6 / d 

( cos 6* -I- sin 6*— + cos Oli? 

e 2\ 06 



Wp. 



The stochastic master equation is then written for the 
spin Wigner function as 



dWp^ 



2 



Wpdt 



(67) 



K 



i-l)(cos6 



(cos 61)) 



cos 9L" 



Wpdv. 
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It is worth noting that the innovation process includes 
second order derivatives L"^ . In the case of the classi- 
cal nonlinear filtering, the innovation term is involved 
in derivatives of at most first order, which occurs if the 
dynamical and measurement noises are correlated. Un- 
like the bosonic case, the stochastic master equation for 
the spin system therefore has no classical counterpart in 
the first or higher order approximation with respect to e, 
and the derivative of second order represents a quantum 
effect of the measurement process. 

To order of 1/e, the stochastic master equation has a 
classical counterpart, and it would be insightful to see 
the corresponding before-measurement system. One can 
easily show that the stochastic master equation is equiv- 
alent to the filtering of the following pre-measurement 
system: 



dx =A:x.dt + Bx dw, 
dm =Cxdt + \/edv, 



(68b) 



where 





r 

2 





h' 




' 0-K O" 


A = 










,B = 


K 






2 




. 








,C = [0 K], 



and X = [x y z] corresponds to each cartesian com- 
ponents of the spin operator, and w,v are independent 
Wiener processes. The double commutation relation, 
[Sz, [Sz, p]], of Ea. (|66|l produces the exponential decay of 
a;, y {A matrix) and mixing of x, y {B matrix) in Ea. H68a| l. 
Apart from the control input /i, z is completely static. 
The second equation shows that the measurement pro- 
cess would be deterministic in the large spin limit e — > 0. 

The measured system is described by the filtering of 
Ea. (|68|l . which is given by 



dx = A±dt + PC^dv, 



1 



P = AP + PA^ + BVB'^ - -PC'^CP, (69b) 

e 

V ^ AV + VA'^ + BVB^, 



(69a) 
(69b) 
(69c) 



where P is the covariance matrix and V is the conditional 
second moment. Note that the control input h is of the 
bilinear form in Eq. (|68(l , so that the covariance matrix P 
is dependent on the control input h, unlike the bosonic 
case of Ea. (|l^ . 



XV. DISCUSSION 

For quantum information theoretical purposes, we 
want to prepare entangled states with the use of feed- 
back. Entanglement can be produced by quantum me- 
chanical ambiguities. In the case of an ensemble of N 
spin-1/2 particles, the coherent superposition of states 
in which half of the spins are up and the rest are down 



is maximally ambiguous, e.g.. 



■ + 1 



where a represents permutation. This state can be char- 
acterized by the mean values of all components of the spin 
operator being zero. In particular, z component is deter- 
ministic, i.e., the variance of z component of this state is 
also zero. The direction of the spins in the xy plane is, 
however, completely indeterminant and this ambiguity is 
the resource of entanglement. 

At first, let us examine the asymptotic behavior of the 
system (I69II . especially the covariance matrix in case of 
h = 0. Assume that the initial state of the S'-spin is a 
spin coherent state pointing x axis. The initial second 
moment is given by 



Vo 










^ 

2 

^ 

" 2 



Ea. (|69() yields the stationary second moment 




1(5 + 1) 
I 



(70) 



Then, the covariance matrix P is given by Ric[-ff], where 
H is defined as 



H 



-El 

2 




-1(54 
















El 

2 











-1(5 + i) 









Ml 

2 








.El 

€ 







Simple manipulation verifies 



2^2 (5 - 



51^(5 - 



(71) 



As expected, the variance of z goes to zero and the other 
two elements are equally distributed. Though z is static 
in the stationary situation, it is not stable as in Eq. (|69a|) 
and fluctuated by the back action during the transitional 
phase. As a result, it is not necessarily possible to ob- 
tain the maximal entanglement by the QND measure- 
ment only. 

It is expected that the maximal entanglement can be 
obtained by stabilizing z . Both of the quantum sys- 
tem under measurements and our knowledge on the sys- 
tem are described by the conditional expectation with 
different initial states. In the case of the linear system 
with an additive control input as in Ea. (|46|l . the covari- 
ance is independent of the input and the difference of the 
initial states converges under a certain condition so that 
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we can make use of linear state feedback. This is not the 
case in general, and the stabilization requires robustness 
for the difference of the initial state, nonlinear feedback 
with higher order correlations and so on. 

For the system (|69f) . stabilization would be simplified 
using switching control. In addition, the design freedom 
is increased by introducing dynamics into the controller 
such that dh = Qdt, where Q is a function. The stabil- 
ity is examined due to a stochastic analog of Lyapunov 
theory "2^. We focus on the stabilization of z and h so 
that it would be enough to consider a Lyapunov function 
of the form U = U{z,h). The infinitesimal operator is 
given by 



d d P"^ d'^ 
oz ou 2 ow^ 



For U = z'^ + h'^, £,U = h{-2xz + Q) + P^^. Since e < 1, 
Ea. (j69b|l leads to Pzz ^ ~Pzz/^- Hence, a controller 
Q = 2xz — kh with k such that k > {Pzz/h)'^ can drive 
z close to zero. Then, the local description introduced 
in Sec lXml is valid and we can utilize the linear control 
introduced in SccKIl 



XVI. CONCLUSION 

In this paper, we started the formulation of quantum 
systems from the general treatment of linear systems with 
the noncommutative input and output. The transfer 
function representation provides the model of the quan- 
tum system not dependent on the commutativity of the 
internal observables. We obtain the quantum mechani- 
cal constraints on the model from the commutation re- 
lation of the input and the output. This constraint can 
be characterized in two different ways. One is the fact 
that the zeros and poles of the transfer functions for the 
two phase are distributed symmetrically in the complex 
plane. This characterization provides important informa- 
tion for quantum system synthesis because the properties 
of the system are completely determined by the poles and 
zeros. The other is concerned with the positivity of the 
solution to the algebraic Riccati equation. According to 
this constraint, there does not exist a quantum system 
which does not satisfies a certain detectability condition. 

We have shown that the quantum stochastic master 
equation naturally follows from the conditional density, 
or the Kalman filter, of the system satisfying the con- 
ditions shown above. Then, the innovation process of 
the Kalman filter can be thought of as the back action 
of the measurement. These are also true for the large 
spin system to zeroth order of the number of spins. If we 
incorporate with higher order approximations, the spin 
system reveals the quantum effect to which there are no 
classical counterparts. 



Appendix : Proof of Eg. (1671) 

Let us consider the commutation relation [Sy,w] first. 
From the definitions 149I57|) . we have 



LM 



where 

[S+ - S-.w] 



L{L + 1) ( „LM+lrT, 



Tr 



Each Clebsch-Gordan coefficient in this equation is cal- 
culated as 



C 



LM+l 
LM 11 



pLM+1 
"^LM 1-1 



L^- AP + L-M 

Y 2i(L+l) ' 
II^ - AP + L + M 



2L{L + l) 

Thus, the commutation relation turns out to be 

[Sy,w] = 



i / Att 



2 V 25 +T ^ TLM{^/^LTl)^M{M~^}YlM-l 

^ LM 

-VL{L + l)-M{M + l)Yl,j+,) 
Using the differential relation of spherical harmonics 



dY, 



^±Af cot 017m = 



± y/L{L + 1) - M(M T l)F£MTle^'^ 
the commutation relation can be rewritten as 



LM 



d 



d 



89 



)}^ 



LyW, 



(72) 



where Ly is an orbital angular momentum operator in the 
cartesian components. That is to say, for the operator w, 
the commutator with respect to the spin operator Sy can 
be replaced by the multiplification of the orbital angu- 
lar momentum operators. For [5*2, w], the commutation 
relation 



[Sz,Tlm] — MTlm, 



leads to 



[Sz/' 



25- 



LM 



LM 



. d 

= -LzW. 



(73) 
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For the anticommutation relation {Sz,w}, let us start 
from the definitions H49I57|) again, i.e., 



In addition, Using the differential relation of spherical 
harmonics 



LM 



The anticommutator of the irreducible tensors is given 
by 

mo,TiA/} =v/3(2TT)^((-l)^' - (-1)^) 



L 1 L' \ ^L'M 



S S S \ lo-'i'M, 
in which Clebsch-Gordan coefficients are given by 



C 



L+iM _ (L + A/ + 1)(L-Af + 1) 

LM 10 



(2L+ 1)(L + 1) 



^+iM _ _ l {L + M){L-M) 
1" " V (2L + 1)L ' 



and the 6j-symbols are 



L 1 L + 1 

s s s 



(-1)^+^ / [23 + L + 2){2S ^ L){L + 1) 
2 Y (2L + 3)(2L + 1)5(5 + 1)(25+1)' 

L 1 L-1 

s s s 

(-1)^ l ~ {2S + L + 2){2S-L + 1)L 
2 V {2L + l)i2L-l)S{S+l)i2S+l)' 



sihB-^Ylm 
aO 



= -{L + 1) cos OYlm 



2L+1 



2L + 3 

one can rewrite the anticommutator as 



((L + 1)2 - AP)Yl+im, 



{Sz,w} = 



4tt 



2S- 



LM 



LM 



2L + 1 



^(25"+ 1)2 - L^(^L cos 6* - sin 6* 



de 



+ v/(2S'+l)2-(L + l)2(i + 1) cos 6* + sin e*— 

On 

Expanding this equation to order of e, we have 



Y, 



LM 



{Sz,w} 



cost 



LM 

|cos0(i(L + l) + l)-|sin0— 



(74) 



r, 



2COS0(i:2 + l) ^ 



where we have used the property of the total angular 
momentum L^Ylm = L{L + 1)Yla/. Eas. H72l73l74|) in 
combination with the definition (|52|l verify Ea. (|67|l . 
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